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Abstract 

We investigate the role of quantum mechanical effects in the central 
stability concept of evolutionary game theory i.e. an Evolutionarily Stable 
Strategy (ESS). Using two and three-player symmetric quantum games we 
show how the presence of quantum phenomenon of entanglement can be 
crucial to decide the course of evolutionary dynamics in a population of 
interacting individuals. 



1 Introduction 

Many interesting results in the recently developed quantum game theory 2, 
^, ^] are about the most fundamental idea in noncooperative game theory [5| 
i.e. the Nash equilibrium (NE). A strategy profile is a NE j|] if no player can 
gain by unilaterally deviating from it. The implicit assumption behind NE is 
that players make their choices simultaneously and independently. This idea 
also assumes that each player participating in a game behaves rational and 
searches to maximize his own payoff. In situations where evolution of complex 
behavior occurs further refinements of NE concept are required , especially, 
when multiple NE appear in the analysis of a game. A refinement is then needed 
to prefer some NE over the others. Due attention has already been given to NE 
in the recent works Q on quantum games and this development has motivated 
us to study certain refinement notions of NE in quantum games. Refinements 
of NE in classical game theory are popular as well as numerous Speaking 
historically, the set of refinements became so large that eventually almost any 
NE could be justified in terms of someone or other's refinement 0. 

An interesting, and fruitful as well, refinement of NE was introduced by 
Maynard Smith in 1970's that became the central notion of evolutionary game 
theory. In his book Evolution and the Theory of Games ^ he diverted attention 
away from elaborate definitions of rationality and presented an evolutionary ap- 
proach in classical game theory. The evolutionary approach can be seen as a 
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large population model of adjustment to a NE i.e. an adjustment of popula- 
tion segments by evolution as opposed to learning. Contrary to classical game 
theory, in evolutionary game theory the individuals of a population, subject to 
evolution, are not assumed to act consciously and rationally. Many successful 
applications of evolutionary game theory appeared in mathematical biology to 
predict the behavior of bacteria and insects that can hardly be said to think at 
all. The most important feature of evolutionary game theory is that the assump- 
tion of rational players, originating from classical game theory, does not remain 
crucial. This important aspect appears when players' payoffs are equated to 
their reproductive success. 

The concept of evolutionary stability stimulated the development of evolu- 
tionary game theory that establishes a link between game theory and the theory 
of evolution. Presently the ESS theory is the central model of evolutionary dy- 
namics of a populations of interacting individuals. It asks, and finds answer 
to it, a basic question: which states, during the course of selection process, of 
a given population are stable against perturbations induced by mutations ]To| . 
The ESS theory is based on Darwin's idea of natural selection; which is shown 
to be describable as an algorithm called replicator dynamic 0. Iterations of 
selections from randomly mutating replicators is an important feature of the 
dynamic. Speaking the language of game theory, the replicator dynamic says 
that in a population the proportion of players which play better strategies in- 
crease with time. When replicator dynamic is underlying process of a game the 
ESSs are shown to be stable against perturbations In other words ESSs 

are, then, rest points of the replicator dynamic. 

Recent developments in quantum games provide an incentive to look at the 
mathematical theory of evolution, with the central idea of an ESS, in a broader 
picture given by Hilbert structure of strategy space in the new theory. This 
incentive is driven by a question: how game-theoretical models, of evolutionary 
dynamics in a population, shape themselves in the new settings provided to the 
game theory recently by quantum mechanics? Our motivation is that quan- 
tum mechanical effects, especially entanglement, may have decisive role in the 
evolutionary dynamics that have already been successfully, and also quite rigor- 
ously, modelled using the classical game theory. To study evolution in quantum 
settings we have chosen the ESS idea mostly for simplicity and beauty of the 
concept. We ask questions like, how ESSs are affected when a classical game 
played in a population changes itself to one of its quantum forms? How pure and 
mixed ESSs are distinguished from one another when such a change in form of a 
game takes place? And most importantly, how evolutionary dynamics becomes 
linked to quantum entanglement present in games that are played in quantum 
settings? 

In earlier papers |jll|, |l^, |l3j we showed that the presence of entanglement, 
in asymmetric as well as symmetric bimatrix games, can disturb the evolution- 
ary stability expressed by the idea of ESS. So that, evolutionary stability of 
a symmetric NE can be made to appear or disappear by controlling entangle- 
ment in symmetric and asymmetric bimatrix games. We found a consideration 
of symmetric games more appropriate because the notion of an ESS was origi- 
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nally investigated Q for pair- wise symmetric contests. In present letter we find 
examples of two and three-player games where entanglement changes evolution- 
ary stability of a symmetric NE. We assume initial quantum states in the same, 
originally suggested, simpler form presented in the scheme |^ that tells how 
to play a quantum game. With initial states in this form, we show that two 
and three-player games are distinguished in an interesting aspect i.e. entangle- 
ment can change evolutionary stability of pure strategies in two-player games. 
However, for a mixed strategy it can be done when the number of players are in- 
creased from two to three. Before coming to quantum settings we first describe, 
mathematically, the concept of an ESS in classical evolutionary game theory. 

2 Evolutionary stability 

Maynard Smith introduced the idea of an Evolutionarily Stable Strategy (ESS) 
in a seminal paper 'The logic of animal conflict' iQ. In rough terms, an ESS 
is a strategy which, if played by almost all members of a population, cannot be 
displaced by a small invading group playing any alternative strategy. Suppose 
pairs of individuals are repeatedly drawn at random from a large population to 
play a symmetric two-person game. Let the game between the individuals be a 
symmetric bimatrix game represented by the expression G = (M, M'^) where M 
represents the payoff matrix and T its transpose. In usual notation P{x, y) gives 
the payoff to a x-player against a y-player for a symmetric pair-wise contest. 
A strategy x is said to be an ESS if for each mutant strategy y there exists a 
positive invasion barrier such that if the population share of individuals playing 
the mutant strategy y falls below this barrier, then x earns a higher expected 
payoff than y. Mathematically speaking, x is an ESS when for each strategy 
y ^ X the inequality P[x, (1 — e)x + ey] > P[y, (1 — e)x + ey] should hold for all 
sufficiently small e > 0; where, for example, the expression on the left-hand side 
is payoff to strategy x when played against the mixed strategy {l — e)x + ey. This 
condition for an ESS can be shown Q easily to be equivalent to the following 
two requirements 

1. Pix,x) > P{y,x) 

2.liP{x,x) = P{y,x) then P{x,y)> P{y,y) (1) 

It becomes apparent that an ESS is a symmetric NE but also possesses a 
stability property against mutations. Condition 1 in the above definition shows 
that (x, x) is a NE for the bimatrix game G — (Af , Al'^) if x is an ESS. However, 
the reverse is not true. If (x, x) is a NE, then x is an ESS only if x satisfies 
condition 2 in the definition (|^). The ESS condition gives a refinement on the set 
of symmetric Nash equilibria Its essential feature is that, apart from being 
a symmetric NE, it is robust against a small number of mutants appearing in a 
population playing an ESS pO| . 

Now we consider quantum settings, involving two players, to investigate the 
concept of evolutionary stability. 
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3 Two-player case 



We use the quantization scheme suggested by Marinatto and Weber |Q] for the 
two-player quantum game of Battle of Sexes. In this scheme the players' tac- 
tics consist of deciding the classical probabilities of applying two unitary and 
Hermitian operators (the identity / and the inversion operator C) on an ini- 
tial quantum strategy in 2 (g) 2 dimensional Hilbert space; that can be obtained 
from a system of two qubits. The tactics phase is similar to probabilistic choice 
between pure strategies in the classical game theory. Interestingly, the classical 
form of the game is reproduced by making the initial quantum state unentangled 
[|. There are some different opinions ^ concerning the use of the term 
strategy in Marinatto and Weber's scheme. Earlier Eisert, Wilkins, and Lewen- 
stein proposed a scheme Q where choosing a move corresponds to a strategy. 
Expanding on this work, Marinatto and Weber presented a different approach 
and preferred to call tactics the process of choosing a move when an initial 
strategy, in the form of a quantum state, is forwarded to the players. In this 
paper we will refer to Marinatto and Weber's tactics as strategies or moves and 
their initial strategy as initial quantum state. We then find how entanglement 
affects evolutionary stability in the circumstances that a quantum version of a 
game can be reduced to its classical form by removing entanglement. Because 
the classical game corresponds to an unentangled initial quantum state, a com- 
parison between ESSs in classical and quantized versions of the game can be 
made by maneuvering the initial quantum state, in some particular form. The 
scheme for two-player quantum game is shown in fig. ^. 

Consider a two-player symmetric game given by the matrix 



Bob's strategy 
Si S2 

Alice's strategy Si {a, a) (/3,7) (2) 
^2 (7,/3) iS,S) 

and played via the initial state \ipin) = a|S'i5'i) -I- b\S2S2) where |a|^ -I- \b\^ = 
1. A unitary and Hermitian operator C used in the scheme is defined as 
C \Si) = \S2), C \S2) = \Si) and C ^ C = C"!. Let one of the players chooses 
his strategy by implementing the identity operator / with probability p and the 
operator C with probability (1 — p), on the initial state Pj„ that corresponds to 
\tpin)- Similarly, suppose the second player applies the operators I and C with 
probabilities q and {1 ~ q) respectively. The final density matrix is written as 

i 

Pf^n= E P^iUA)Pr{UB)[UA®UBP,nUl<E>Ul] (3) 
U=I,C 

where the unitary and Hermitian operator U is either / or C. Pr(t/4), Pr(J7s) 
are the probabilities with which players A and B apply the operator U on 
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Figure 1: The scheme to play a two-player quantum game. 



the initial state, respectively. It is seen that corresponds to a convex 

combination of all possible quantum operations. Payoff operators for Alice and 
Bob are ^ 

(Pa + (3, j\SiS2) + 7, /3 \S2S1) + S, S \S2S2) 

The payoffs are then obtained as mean values of these operators i.e. Pa,b = 
Tr [{PA,B)oper p fin] ■ Bccause the quantum game is symmetric using the initial 
state IV'in) ^nd the payoff matrix there is no need for subscripts. We, 
therefore, write the payoff to a p player against a q player as P{p, q). When p 
is a NE we find the following payoff difference 

P{p;p)-P{p,p)^{p-p)[\a\'{p~5) + 

\h\\^-a)-p{{(3-5) + {^-a)}] (4) 

Now the ESS conditions for the pure strategy p — Q are given as 

1. {{P - 5) - - a)} > {P - 5) 

2. If |fe|2{(/3„5)_(^_c.)}-(/3~,5) 

then q^ {{P - 5) + [-1 - a)} > Q (5) 
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where 1 is the NE condition. Similarly the ESS conditions for the pure strategy 
p = 1 are 



1. \b\^ {{j - a) - ip - S)} > {j - a) 

2. If \b\^ {{j - a) ^ {13 - S)} ^ (j - a) 

then {1 - qf {{(3 - S) + {-f - a)} > (6) 

Because these conditions for both the pure strategies p = 1 and p = depend on 
therefore, there can be examples of two-player symmetric games for which 
the evolutionary stability of pure strategies can be changed while playing the 
game using initial state in the form IV'm) = a \SiSi) +b 18282)- However, for the 
mixed NE, given as p = °^ '(pZs)+\''j-2)~"'' ' corresponding payoff difference 
^ becomes identically zero. From the second condition of an ESS we find, for 
the mixed NE p, the difference 



P{p,q)-P{q,q) 



(/? - <5) + (7 - a) 



[(/? -S)-q{{f3-5) + {j- a)} - \b\' {{(3 - <5) - (7 - «)} (7) 

Therefore, the mixed strategy p is an ESS when — (5) + (7 — a)} > 0. This 
condition, making the mixed NE p an ESS, is independent of \bf 0. So that, 
in this symmetric two-player quantum game, evolutionary stability of the mixed 
NE p can not be changed when the game is played using initial quantum states 
of the form |V',„) = a \8i8i) + b \S282). 

Therefore, evolutionary stability of only the pure strategies can be affected, 
with the chosen form of the initial states, for the two-player symmetric games. 
Examples of the games with this property are easy to find. The class of games 
for which j ^ a and {(3 — S) < the strategies p — and p — 1 remain NE 
for all |6| e [0, 1]; but the strategy p = 1 is not an ESS when \b\ — and the 



strategy p = is not an ESS when |6| = 1. In an earlier letter 1 12 wc found an 



example of a class of games for which a pure strategy, that is an ESS classically. 



does not remain ESS for a particular value of |6|^,even though it remains a NE 
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for all possible range of |&| 

To find examples of symmetric quantum games, where evolutionary stability 
of the mixed strategies may also be affected by controlling the entanglement, 
we now increase the number of players from two to three. 



4 Three-player case 

In extending the two-player scheme to a three-player case, we assume that three 
players A, B, and C play their strategies by applying the identity operator / 
with the probabilities p, q and r respectively on the initial state \'ipin)- Therefore, 
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they apply the operator C with the probabihties (1 — p), (1 — q) and (1 — r) 
respectively. The final state then corresponds to the density matrix 



PHn= E ^^{UAWUB)'Pr{Uc)[UA®UB®UcPinUi®Ul®Ul\ (8) 
U=I,C 

where the 8 basis vectors are \SiSjSk), for i,j,k = 1,2. Again we use initial 
quantum state in the form = a \S-iSiSi) +b \S2S2S2), where |a|^ + = 1. 
It is a quantum state in 2 (g) 2 (g) 2 dimensional Hilbert space that can be prepared 
from a system of three two-state quantum systems or qubits. Similar to the two- 
player case, we define the payoff operators for the players A, B, and C as 



{PA,B,c)oper = 

ai,l3-y,ri-y |S'i5i5i) (^i^i^i] +02, /Sa,^ I'5'25'i5i) (525i5i| + 
a3,/33;% |S'iS'25i) (5'iS'2S'i| + a4,/34:'74 |5'iS'i52) (5i5i52| + 

a5,/35>% l'S'15'25'2) (5'lS'2'S'2| +a6,/36>'?6 l'S'2'S'lS'2) {S2SiS2\ + 

ar,f3„vr 182828^) {828281] + as, f3s,Vs \828282) {828282] (9) 

where ai,f3i,rii for 1 < / < 8 are 24 constants of the matrix of this three-player 
game. Payoffs to the players A, B, and C are then obtained as mean values of 
these operators 



Pa,B,c{P, q, r) = Trace [{PA,B,c)operPfin] (10) 

Here, similar to two player case, the classical payoffs can be obtained by making 
the initial quantum state unentangled and fixing \bf' = 0. To get a symmetric 
game we define Pa{x, y, z) as the payoff to player A when players A, B, and C 
play the strategics x,y and z respectively. Following relations make payoffs to 
the players a quantity that is identity independent but depends only on their 
strategies 

PA{x,y,z) = PA{x,z,y) = PB{y,x,z) 
= PB{z,x,y) = Pc{y,z,x) = Pc{z,y,x) (11) 

For these relations to hold we need following replacements for and 'q^ 



Pi - 


ai 


P2- 


as 


Ps- 


a2 


P4- 


as 


p, - 




Pe- 


as 


Pr- 


ae 


P8- 


as 


Vi - 


ai 


V2 - 


as 


Vs - 


■> as 


V4 - 


■> a2 


V5 - 


ae 


Ve - 


a^ 


V7 - 


-> as 


r]8 - 


■> as 



(12) 
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Also, it is now necessary that we should have ag — aj and as = 0:4. A symmetric 
game between three players, therefore, can be defined by only six constants. 
We take these to be ai, 012, as, as, ag and, ag. The payoff to a player now 
becomes only a strategy dependent quantity and becomes identity independent. 
No subscripts are therefore, needed. Payoff to ap player, when other two players 
play q and r, can now be written as P{p, q,r). A symmetric NE p can be found 
from the Nash condition P{p,p,p) — P{p,p,p) > i.e. 

P{p.P,p) - P{p,p*p) = (p - p)\p{l - 2 \hf){a + - 2ry) + 
2p{|6|^(a + w-2?7)-t^ + r;} + {t^- |6|^((T + tj)}] >0 (13) 

where (ai — 0.2} = a, (as — ag) = 77, and (05 — as) = ^- Three possible NE are 
found as 



* _ {{i^-^)-\b\''(a+i^-2^)}±^{(a+^Y-(2r,Y}\b\^^{l-\b\^^) + {^■^-a~) 

P3 = 1 

Clearly the mixed NE pi makes the difference P{p,p,p) — P{p,p,p) identically 
zero and two values for p^ can be found for a given P2, p^a-ie pure strategy 
NE. We notice that pi comes out as a NE without imposing further restrictions 
on the matrix of the symmetric three-player game. However, the pure strategies 
P2a.nd PsCan be NE when further restriction are imposed on the matrix of the 
game. For example, p^can be a NE provided a > {uj + a) \b\^ for all \b\^ E [0, 1]. 
Similarly P2can be NE when uj < {uj + a) \b\^ . 

Now the question we ask: how the evolutionary stability of these three NE 
can be affected while playing the game via the initial quantum states given 
in the form = a|5i5i5i) + fe|5252S'2)?. For the two-player asymmetric 

game of Battle of Sexes we showed that out of the three NE only two can be 
evolutionarily stable [0. In classical evolutionary game theory the concept of 
an ESS is well known to be extended to multi-player case. When mutants are 
allowed to play only one strategy the definition of an ESS for three-player case 
is written as [IlSl 



1. P{p,p,p) > P{q,p,p) 

2.1iP{p,p,p) = P{q,p,p) then P{p,q,p) > P{q,q,p) (15) 

Here p is a NE if it satisfies the condition 1 against all q p- For our case the 
ESS conditions for the pure strategies P2&nd p^ can be written as follows. For 
example, P2 — is an ESS when 
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1. a\b\^ > u\a\^ 

2. Ua\b\^ = w|a|^ then -77g2(|a|2_ |;,|2) > (16) 

where 1 is NE condition for the strategy = 0- Similarly = 1 is an ESS 
when 



1. cr\a\^ > uj\bf 

2.lia\af = cj|fe|^ then 7/(1 -g)2(|a|2 - > (17) 

and both the pure strategies P2a.nd are ESSs when |a|^ = \b\^ . Examples of 
three-player symmetric games are easy to find for which a pure strategy is a NE 
for the whole range \b\^ G [0, 1], but does not remain an ESS for some particular 
value of |5| . An example of a class of such games is for which a = 0,uj < and 
?7 < 0. In this class the strategy = is a NE for all \b\^ e [0, 1] but not an 
ESS when = 1. 

However, the mixed strategy NE pi forms the most interesting case. It 
makes the payoff difference P{pi,pi,pi) — P{p,pi,pi) identically zero for every 
strategy p. Now pi is an ESS when ^P{pi,q,pi) — P{q,q,pi)^ > but 

= ±{Pi - 9) V{(^ + (2^)2} \b\' (1 - + (7/2 _ (18) 

Therefore, out of the two possible roots {pi)i and {pi)2, that make the difference 
PiPitQjPi) ~ PiQjQjPi) greater than and less than zero respectively, of the 
quadratic equation 



pi^{l~-2\b\^){a + uj-2jj) + 
2pi \^\bf {a + uj - 27]) - uj + + - \b\^ {(J + uj)^ =0 (19) 

only {pi)i can exist as an ESS. When the square root term in the equation 
( p^ becomes zero we have only one mixed NE, that is not an ESS. Therefore, 
out of four possible NE in this three-player game only three can be ESSs. An 
interesting class of three-player games is one with 77^ = aui. For these games the 

• 1 AT-c, * {{w-7j)-\b\^{<7+uj-2r])}±\a\\b\\a-uj\ , , l j l ■ u 

mixed JNE arepi ~ (i-2|b|^)(g+i.cj-2t)) a.na, when played classically, 

we can get only one mixed NE that is not an ESS. However for all |5|^, different 
from zero, we generally obtain two NE out of which one can be an ESS. 

Similar to the two-player case, the NE in a three-player symmetric game 
important from the point of view of evolutionary stability are those that survive 
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a change between two initial states; one being unentangled corresponding to the 
classical game. Suppose pi remains a NE for \b\ =0 and some other non-zero 
\b\^ . It is possible when (tT—ijj)(2pi — l) = 0. One possibility is the strategy p = ^ 
remaining a NE for all \bf G [0, 1]. It reduces the defining quadratic equation 
for pi to a + uj + 2rj = and makes the difference P{pi, q,pi) ~ P{q,q,pi) 
independent of \b\^ . Therefore the strategy p = i, even when remaining a NE 

for all \b\^ G [0,1], can not be an ESS in only one version of the symmetric 
three-player game. For the second possibility a — lo the defining equation for 
Piis reduced to 



(20) 

for which 



1*1' 4 



(21) 



Here the difference P{pi,q,pi)—P{q, q,pi) still depends on |&| and becomes zero 
for |6|^ = i. Therefore for the class of games for which a = uj and rj > a, one of 
the mixed strategies {pi)i, {pi)2 remains a NE for all g [0, 1] but not an ESS 



when |6| 



In this class of three-player quantum games the evolutionary 



stability of a mixed strategy can, therefore, be changed while the game is played 
using initial quantum states in the form IV'm) = a jS'iS'iS'i) 4- b \S2S2S2)- 



5 Discussion 

The fact that classical games are played in natural macroscopic world is well 
known for a long time. Evolutionary game theory is a subject, growing out 
of such studies and, dealing mostly with games played in the animal world. 
Recent work in biology |^ suggests nature playing classical games at micro- 
level. Bacterial infections by viruses have been presented as classical game-like 
situations where nature prefers the dominant strategies. The concept of evo- 
lutionary stability, without assuming rational and conscious individuals, gives 
game-theoretical models of stable states for a population of interacting indi- 
viduals. Darwinian idea of natural selection provides physical ground to these 
models of rationality studied in evolutionary game theory. Why there is need 
to study evolutionary stability in quantum games? We find it interesting that 
some entirely quantum aspect like entanglement can have a deciding role about 
which stable states of the population should survive and others should not. 
It means that the presence of quantum interactions, in a population undergo- 
ing evolution, can alter its stable states resulting from evolutionary dynamics. 
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When entanglement decides the evolutionary outcomes, the role for quantum 
mechanics clearly increases from just keeping atoms together that constitute 
molecules. This new role may now also include to define and maintain com- 
plexity emerging from quantum interactions among a collection of molecules. It 
becomes even more interesting with reference to the example of equilibrium in 
a mixture of chemicals presented above. When quantum nature of molecular 
interactions decides the equilibria that the mixture of Schuster et al. |^ should 
be able to attain, there is a clear possibility for the quantum mechanical role in 
the models of self-organization in matter and the evolution of macromolecules 
before the advent of life. 

We have two suggestions where this finding, about quantum effects decid- 
ing evolutionary outcomes in a population of interacting entities, can have a 
relevance 

5.1 Genetic code evolution 

The genetic code is the relationship between the sequence of the bases in the 
DNA and the sequence of amino acids in proteins. Recent work |^ about 
evolvability of the genetic code suggests that the code, like all other features 
of organisms, was shaped by natural selection. The question about the pro- 
cess and evolutionary mechanism by which the genetic code was optimized is 
still unanswered. Two major suggested possibilities are (a). A large number of 
codes existed out of which the adaptive one was selected, (b). Adaptive and 
error-minimizing constraints gave rise to an adaptive code via code expansion 
and simplification. The second possibility of code expansion from earlier simpler 
forms is now thought to be supported by much empirical and genetic evidence 
[ p3| and results suggest that the present genetic code was strongly influenced by 
natural selection for error minimization. Recently Patel suggested quantum 
dynamics played a role in the DNA replication and the optimization criteria in- 
volved in genetic information processing. He considers the criteria involved as 
a task similar to an unsorted assembly operation where the Grover's database 
search algorithm |^ fruitfully applies; given the different optimal solutions for 
classical and quantum dynamics. The assumption underlying this approach, as 
we understood it, is that an adaptive code was selected out of a large num- 
bers that existed earlier. Recent suggestions about natural selection being the 
process for error minimization in the mechanism of adaptive code evolution 
suggests, instead, an evolutionary approach for this optimization problem. We 
suggest that, in the evolution and expansion of the code from its earlier sim- 
pler forms, quantum dynamics too has played important role. The mechanism, 
however, leading now to this optimization will be completely different. Our 
result that stable outcomes, of an evolutionary process based on natural selec- 
tion, depend on presence or absence of quantum entanglement clearly implies 
the possibility that other quantum interactions may also have deciding role in 
obtaining some optimal outcome of evolution for a system of molecules consti- 
tuting a population. The mathematically rigorous representation of stability in 
an evolutionary dynamics, based on Darwinian selection, is the concept of an 
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ESS. We believe that the code optimization is a problem having close similari- 
ties with the problem of evolutionary stability. By showing that entanglement 
can bring or take away evolutionary stability from a symmetric NE we have in- 
dicated that the code optimization was probably achieved by forces and effects 
that were quantum mechanical in nature. 

5.2 Quantum evolutionary algorithms 

A polynomial time algorithm that can solve an NP problem is not known yet. A 
viable alternative approach, shown to find acceptable solutions within a reason- 
able time period, is the evolutionary search |2^. Iteration of selection based on 
competition, random variation usually called mutation, and exploration of the 
fitness landscape of possible solutions are the basic ingredients of many distinct 
paradigms of evolutionary computing p7| . On the other hand superposition of 
all possible solution states, unitary operator exploiting interference to enhance 
the amplitude of the desired states, and final measurement extracting the so- 
lution are the components of quantum computing. These two approaches in 
computing are believed to represent different philosophies ||2^. Finding ESSs 
can be easily formulated as an evolutionary algorithm with mutations occurring 
within only a small proportion of the total population. In fact ESSs also con- 
stitute an important technique in evolutionary computation. Our proposal that 
entanglement has a role in the theory of ESSs suggests that the two philosophies, 
considered different, may have some common grounds that possibly unites them. 
It also hints the possibility of other evolutionary algorithms that utilize or even 
exploit quantum effects. In an evolutionary algorithm, exploiting quantum ef- 
fects, we may have, for example, fitness functions depending on the amount of 
entanglement present. The interesting question then is: how the population will 
evolve towards a solution or an equilibrium in relation to the entanglement? 

6 Conclusion 

In this paper we have shown that the idea of evolutionary stability, the central 
stability concept of evolutionary game theory, can be related to quantum entan- 
glement. We investigated ESSs in three-player quantum games and compared 
them to two-player games played by a proposed scheme where two, Hermitian 
and unitary, operators are applied on an initial quantum state with classical 
probabilities. We used the initial quantum state in the same form proposed by 
Marinatto and Weber |^ . In two-player symmetric games we found that evolu- 
tionary stability of a mixed strategy can not be changed by a unitary maneuver 
of the initial quantum state. However, for a class of three-player symmetric 
games it becomes possible to do so. It shows that the presence of quantum 
mechanical effects may have a deciding role on the outcomes of evolutionary 
dynamics in a population of interacting entities. We suggested that a relevance 
of these ideas may be found, for example, in the studies of the evolution of 
genetic code at the dawn of life. Another suggestion is designing evolutionary 
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algorithms where interactions between individual of a population are governed 
by quantum effects. The nature of these quantum effects, influencing the course 
of evolution, will also determine the evolutionary outcome. Quantum mechan- 
ics playing a role in the theory of ESSs implies that Darwin's idea of natural 
selection has a relevance even for quantum systems. 
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